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Abstract 



We consider Kleinberg's celebrated small world graph model 12|13 , in which a £)-dimensional 
grid {0, . . . ,n — 1}^ is augmented with a constant number of additional unidirectional edges 
leaving each node. These long range edges are determined at random according to a probability 
distribution (the augmenting distribution), which is the same for each node. Kleinberg suggested 
using the inverse D-th power distribution^ in which node v is the long range contact of node u 
with a probability proportional to |ju — wjl^ ^ ■ He showed that such an augmenting distribution 
allows to route a message efficiently in the resulting random graph: The greedy algorithm, where 
in each intermediate node the message travels over a link that brings the message closest to the 
target w.r.t. the Manhattan distance, finds a path of expected length 0((logn)^) between any 
two nodes. In this paper we prove that greedy routing does not perform asymptotically better 
for any uniform and isotropic augmenting distribution, i.e., the probability that node u has a 
particular long range contact v is independent of the labels of u and v and only a function of 
ll"-«llr 

In order to obtain the result, we introduce a novel proof technique: We define a so-called 
budget game, in which a token travels over a game board, from one end to the other, while the 
player manages a "probability budget" . In each round, the player "bets" part of her remaining 
probability budget on step sizes. A step size is chosen at random according to a probability 
distribution of the player's bet. The token then makes progress as determined by the chosen 
step size, while some of the player's bet is removed from her probability budget. We prove a 
tight lower bound for such a budget game, and then obtain a lower bound for greedy routing in 
the J9-dimensional grid by a reduction. 
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1. Introduction 



In 2000, Kleinberg proposed his celebrated small world graph model to study the performance 
of decentrahzed search in augmented networks [I2|[l3) . His original network model was based on 
an n X n grid with vertex set {{x,y) : x,y £ {0, ...,n — 1}}, and the Manhattan (or lattice) 
distance as a distance metric. (I.e., the distance between two points u = {x,y) and u' = (x',y') is 
= \x — x'\ + \y — y'\.) For some constant p, every node u has a directed edge to every 
other node v within distance p (f is a local contact of u). In addition, for some universal constants 
r, g, every node u has q additional directed edges to other nodes, called long range contacts. The 
long range contacts of u are determined by q independent random trials, where a particular node 
V is chosen according to the inverse r-th power distribution, i.e., with probability proportional 
to itjull]^ ^. Kleinberg showed that in such a network with r — 2 and p — q — la simple 
decentralized routing algorithm can efficiently route a message from any given source to any given 
target. More precisely, he proposed the greedy algorithm, where in each intermediate node the 
message travels over a link whose endpoint minimizes the remaining Manhattan distance to the 
target. Kleinberg showed that this algorithm yields a route of expected length 0((logn)^). This 
result can be generalized to D dimensions for any constant > 1: In this case, the expected greedy 
routing length is quadratic in logn if r = D. The parameter r = D is in fact optimal, as for r ^ D 
no decentralized algorithm can find a route in poly- logarithmic time (see also jl^). 

Following Kleinberg's seminal work, more general models were studied, and over the last decade a 
rich theory of decentralized algorithms and their performance in augmented networks was devel- 
oped. (See for example the surveys by Fraigniaud |6j and Kleinberg [l5].) An augmented network, 
as defined in its general form for example by Fraigniaud, Lebhar, and Lotker [s], consists of a di- 
rected base graph of N nodes which defines the local contacts of nodes, together with a probability 
distribution for long range contacts, called augmenting distribution. An instance of an augmented 
network is a random graph which has all the vertices and directed edges from the base graph as well 
as additional directed long range edges from each node to its long range contacts, which are chosen 
at random according to the augmenting distribution. Usually, a distance metric is associated with 
the network. The distance between two nodes can be, for example, the length of the shortest path 
between them on the base graph. For algorithmic purposes, the distance between nodes is expected 
to be easy to compute or to approximate locally ^ . The augmenting distribution is usually uniform 
and isotropic in the sense that the probability that node u has a particular long range contact v 
does not depend on the labels of u and v, but only on the distance from u to v. 



Uniform isotropic augmented networks were first considered by Watts and Strogatz 20 as a math- 
ematical model to understand the "small-world phenomenon" occurring in social networks and the 
web. The most prominent example of the phenomenon is the existence of short chains of acquain- 
tances, or "six degrees of separation", between individuals in the United States, as observed in 



Milgram's famous experiment 18 



While earlier work, including that of Watts and Strogatz's, was concerned with structural prop- 



erties of augmented networks, Kleinberg 12,13] started to study the question of navigability, i.e., 
whether short paths can be found efficiently in augmented networks. He suggested using decentral- 
ized algorithms for routing messages. In such algorithms routing decisions are made locally: The 
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node that holds the message determines the (local or long range) contact to send the message to, 
using only local information. The message holder can use knowledge about the base graph, the 
location of the target on the base graph, and the locations and long-range contacts of nodes that 
have come in contact with the messages. However, the message holder has no information about 
the long range contacts of nodes that have not yet touched the message. 

The simplest, most natural and consequently best studied decentralized algorithm is the greedy 
algorithm, in which the message holder passes the message on to its local or long range contact 
which is closest to the target (according to the distance metric associated with the base graph). 
This led to the definition of the greedy diameter of an augmented graph, which is the maximum 
of the expected routing times of all pairs of source and target nodes in the base graph [s]. Aspnes, 
Diamadi, and Shah [l] observed the usefulness of greedy routing in augmented graphs for peer-to- 
peer networks; several peer-to-peer systems such as Chord [9,19 , Symphony |fl^ or Randomized- 



Chord [liy2l| are based on augmented rings. In all those systems the augmenting distribution is 
based on the inverse r-th power distribution, and the expected greedy routing time between any 
pair of nodes is 0((logn)'^) (or 0((logn)^/fc) if the number of long range contacts per node, k, is 
super-constant but logarithmic). 

This raised the question whether there exist uniform and isotropic augmenting distributions that 
yield faster greedy routing times. Several attempts were made to find an answer to this question, 
but until now succeeded only in restricted settings. In fact, general lower bounds obtained in the 
past hold only for the one-dimensional case, where the base graph is the line or the ring: Flam- 
mini, Moscardelli, Navarra, and Perennes [s] showed an optimal lower bound of r2((logn)^) for 
the "oblivious diameter" of the augmented line with an augmenting distribution that satisfies a 
monotonicity requirement. (The oblivious diameter is a measure that is potentially larger than 
the greedy diameter.) A tight lower bound for the greedy diameter of the augmented ring, where 
the augmenting distribution is the r-th power distribution with r = 1, was obtained by Barriere, 
Fraigniaud, Kranakis, and Krizanc f2]. Almost tight lower bounds for all uniform and isotropic 
augmenting distributions were provided by Aspnes, Diamadi, Shah |lj and were subsequently im- 



proved by Giakkoupis and Hadzilacos 10 . Tight lower bounds for the greedy diameter of the line 
of length n with one long range contact per node were obtained by Dietzfelbinger, Rowe, Wegener, 
and Woelfel [sj. Finally, Dietzfelbinger and Woelfel jij proved a tight lower bound of ri((logn)^//c) 
for the greedy routing time between randomly chosen start and target nodes for the augmented 
ring and line with k = O(logn) long range contacts per node. (The lower bound also holds if the 
source and target nodes are chosen at random.) 



1.1. Results 

In contrast to the one-dimensional case, no very general lower bounds were known for the two- 



dimensional or even higher dimensional case. Kleinberg 13 proved a lower bound of n^*-^^ for the 
expected routing time of any decentralized algorithm in the augmented two-dimensional grid, if 
the augmenting distribution is the inverse r-th power distribution for r ^ 2. The result extends 
to the D-dimensional case if r 7^ Z). In the D-dimensional grid augmented with the inverse D-th 
power distribution, the greedy diameter is G ((log n)^) , i. e., Kleinberg's upper bound is tight [7,17 
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Similar lower bounds hold also if the L>-dimensional torus (i.e., the grid with wrap-around links) 
is used as a base graph. 

We are not aware of any lower bounds for general uniform and isotropic augmenting distributions 
in the Z)-dimensional grid or torus for D > 2. This raises the question whether for D > 2 the 
inverse D-th power distribution is in fact optimal among all uniform and isotropic augmenting 
distributions. In this paper we answer the question in the affirmative. More precisely, we consider 
as a base graph the Z)-dimensional torus {0, . . . , n — 1}^ with N = nodes. We show for any 
such augmenting distribution and any two nodes s, t with — t||]^<n/4 that the expected greedy 
routing time from s to t is 17 ((log ||s — The same is true for the D-dimensional grid as a 

base graph, as long as s and t have distance at least 2 ||s — from the border of the grid. 

Note that the restriction of isotropy is necessary for such a strong lower bound: It prevents us from 
defining for some given pair (s, t) an augmenting distribution, where there is always a short greedy 
route from s to t (for example, because s has long range contact t with probability 1). On the other 
hand, non-isotropic but uniform augmenting distributions might still have a large greedy diameter. 

For simplicity of exposition, we consider only the case that every node has one long range contact. 
It is not hard to see that our lower bound extends to the case where every node has a constant 
number of long range contacts chosen independently at random according to the same augmenting 
distribution. Similarly, the lower bound result is not affected if in the base graph any two nodes 
within Manhattan distance p are connected, where p is some constant. 

Note that the lower bound holds for any source/target pair in the higher dimensional torus or 
grid. This is not the case for D = 1 (where the base graph is a ring or a line): For example the 
augmenting distribution may have the property that each node has a long range contact at distance 
n/2 with high probability. If this is the case, the expected greedy routing time can be very small if 
the distance between the source and target is exactly n/2. In higher dimensions this cannot happen, 
as for a given distance d and a given node u there are sufficiently many choices of possible long 
range contacts v with ||ii — = d. 



1.2. The Lower Bound Technique 

The lower bound proofs for the one-dimensional case were of increasing difficulty. The result by 
Dietzfelbinger et al. [s] uses a quite complicated potential function. The lower bound in |4| is based 
on an argument that with each step made by the greedy routing algorithm associates a cost and 
shows that the expected cost per step is constant, while the total cost of an entire run is f7(log^ n). 
Both the potential function of and the cost function of [4j are rather difficult to motivate and 
lead to verifiable but not very intuitive proofs. 

The proof presented in this paper is quite different from any previous lower bound techniques we 



know of, and in particular from those used in the one-dimensional case |l||3||4, 10 . We also believe 
that it is significantly more intuitive, and, while technically challenging, the general approach can 
be motivated more easily. 

We define a probabilistic game, called budget game, played in rounds by a single player. Then we 
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prove a lower bound on the expected number of rounds it takes the player to finish the game. 
Finally we show that the expected number of rounds is a lower bound for the expected routing 
time in the Z)-dimensional torus. The lower bound for the budget game is proved by induction. The 
inductive hypothesis can be motivated easily. The inductive step is somewhat involved, but not too 
hard to verify. The biggest problem to overcome in the course of building the overall argument was 
in designing the game, tuning its details, and choosing its parameters in such a way that both the 
proof of the lower bound and the proof of the connection with the routing time goes through. 

The budget game is played on a game board with do + 1 spaces, labeled do, do — l, • • • > from left to 
right. The player starts with a token at the leftmost space, do, and her goal is to move the token to 
space in as few rounds as possible. The player also manages a probability budget. In each round, 
the player "bets" a probability distribution /3 over {1, . . . , d}, where d is the current location of the 
token. The total bet on step sizes larger than 1 must not exceed her remaining probability budget, 
B, i.e., /3([2,d]) < B. Moreover, in order to prevent the token from moving too fast, bets on step 
sizes larger than d/2 are also constrained. Now a step size i is chosen at random according to /3, and 
the player can move her token i positions to the right. The player loses a portion of her probability 
budget, which is determined by how much she bet on step sizes larger than i/2 and by the amount 
of progress made (relative to the remaining distance). 

The connection to greedy routing on a grid is as follows: The remaining distance the player has to 
travel on the game board corresponds to the distance on the grid between the message holder, u, 
and the target. The remaining probability budget, B, corresponds to the probability that u has a 
long range contact which is closer to the target than u itself. The bet /3 of a player is determined by 
the augmenting distribution: /3(i) is roughly the probability that u has a long range contact v whose 
distance to the target is by i smaller than w's distance to the target. As the message gets closer to 
its target, longer distances of long range contacts become useless. The probability of choosing long 
range contacts which are "too far away" is captured in the budget game by the budget loss. 

The constraint in the budget game on bets on large step sizes, i.e., step sizes larger than d/2, 
is justified by the isotropy of the augmenting distribution and the topology of the base graph: 
Suppose on the D-dimensional torus the message holder, u, is in distance d of the target node. 
Even if the augmenting distribution dictates that the randomly chosen long range contact v u 
is with probability 1 in the "optimal" distance from node u (whatever distance is optimal), the 
probability that v will not be closer than d/4 to the target is constant. This is because all nodes at 
the same distance from u will be chosen with the same probability as long range contacts and only 
a constant fraction of them can be closer than d/4 to the target. More generally, u's long range 
contact will be closer than d' < d/2 to the target only with probability 0(d'/d). 

There is quite some flexibility in defining the probability budget game precisely, i.e., how big the 
budget loss is in each step and how to constrain bets on step sizes larger than d/2. We chose those 
parameters in such a way that it fits our application, but we believe that the general concept of a 
budget game is interesting in its own right. 

In Section [2| we describe the budget game in more detail and analyze it. In Section [3] we prove the 
lower bound for the greedy routing time in augmented grids by showing that each distribution on 
the long range contacts gives rise to a strategy for the budget game, so that routing times translate 
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into upper bounds on the expected time for the budget game. So our lower bound for the budget 
game leads to a lower bound for the routing situation. 

Throughout the text, "In" denotes the natural logarithm (to base e) and "log" denotes the logarithm 
to base 2. For ease of notation we write log'^x instead of (logx)'^ and lif x instead of (Inx)'^. 

2. The Budget Game 

The budget game is played in rounds on the set {0, 1, . . . , do} as "gameboard". There are two 
parameters: d is the remaining distance to be covered, and B is the remaining budget. The "player" 
starts with a token at distance d = do and wishes it to reach 0. She manages a budget, which 
initially has value B = Bq. In a round, within the limits of the current budget and obeying some 
other restrictions the player can choose ("bet") probabilities for certain distances to appear. A step 
size i is chosen at random, according to these probabilities. Then the distance d is reduced by the 
chosen value i, and the budget B is reduced by an amount that depends on the jump distance i 
and on the probabilities used in the betting. 

Our goal is to establish lower bounds on the expected number of moves needed when starting in do 
with budget Bq. 

More precisely, when in state {d, B), one round of the game comprises the following actions. 

1. The player chooses a valid bet for budget B and distance d, which is a probability distribution 
(3 over step sizes {1, . . . ,d}, satisfying the following constraints: 

(Bl) m,d])<B; 

(B2) for ah 1 < j < d* = \d/2] =d - [d/2\ : 

f5{[d-j + l,d]) ^ 2j 
(3{[d-d* + l,d]) - d*' 

The first constraint bounds the probability of choosing step sizes larger than 1 by the remain- 
ing probability budget. The second constraint bounds the conditional probability of choosing 
a very large step size (close to the remaining distance d) given that the step size is at least half 
the remaining distance d. Note that the probabilities for step sizes up to d — d* = \d/2\ are 
not constrained; for example, a strategy in which a step size of \_d/2\ occurs with probability 
1 is allowed. (Such a strategy would not be very efficient, though, as the probability budget 
would get reduced by a constant in one step.) 

2. A random step size i is chosen from {1, . . . , d} according to the probability distribution (3. 

3. Progress: Let d = d — i. 

4. Budget loss: If i > 2, let B = B-{i/ df'^ l3{{i/2, d\)^ (For i = 1 the budget loss is 0.) 
^For real numbers x < y the interval {x,y] is {i £ N \ x < i < y}; similarly for closed intervals [x, y]. 
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This budget loss depends on the "order of magnitude" of the jump i actually chosen. The 
amount the player loses is determined by the total amount bet on the jump sizes in this order 
of magnitude and larger. If i is close to d, a constant fraction of this is lost; if i is smaller 
than d by a factor of q, the loss is scaled down by a factor of g^/^. The basic idea would be to 
collect a fraction of q of the amount bet, to reflect the idea that 1/q jumps with a distance 
of about d/i would suffice to reach the goal, so that no budget for jumps of this order of 
magnitude is needed anymore. For technical reasons the formula is modified a little. 

The game ends when d becomes 0. 

Note that there is no budget loss in case the step size i is 1, but the player makes progress in this 
case, too. Hence, even when the player runs out of budget she can still finish the game; the worst 
case time is do. We assume the player has chosen a strategy S that for each combination {d,B) 
dictates which distribution to choose in Step 1. Of course, the idea is that this strategy is chosen 
so as to keep the expected number of rounds until d = is reached as small as possible. 

We give an example for a strategy. Say the initial budget is Bq = 1. In distance d the player bets 
l/log(do) on distance [d/2j and nothing on other distances. Since the expected waiting time for 
a jump with i = [d/2j is l/log(do), and since after log(do) such jumps the remaining distance d 
cannot be larger than 2, the expected number of rounds is smaller than log^(do) + 2. 

2.1. The main theorem 

We assume that Bq > 1. (This will be justified by the applications.) The following theorem is the 
first main result of this paper. 

Theorem 1 Assume the budget game is started with distance do and a starting budget Bq > 1, 
using an arbitrary fixed strategy S. Then the expected number of rounds is $7(log^(do)/-Bo) . 

For 1 < d < n and B > 1 let T^^b denote the expected number of rounds until state is reached 
when the budget game is run with strategy S, starting in distance d with budget B. Theorem [T] 
states that Tdo^Bo = (log^(do)/-Bo) . 

For proving the theorem, we proceed by induction. The following lemma formulates the inductive 
assertion. It is convenient to use the natural logarithm, here. 

Lemma 2 (Main Lemma) There is a constant a > such that Td^B ^ oi ■ ln^(d)/(l + B), for all 
d>l and all B>0. 

Due to the assumption Bq > 1 in Theorem [T| the theorem is immediately implied by the Main 
Lemma. The offset by 1 in the denominator of the lower bound in the induction hypothesis (which 
does not occur in the corresponding lower bound of Theorem [T]) is necessary. In fact, since the 
budget game always finishes after 0(do) rounds, the theorem would not hold if we allowed very 
small values of Bq, e. g., for Bq = o(ln^(do)/do). 
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The lemma is true for d = 1, as Ti^b = 1 > 0. By choosing a appropriately we may even say that 
it is true for 1 < d < dbase for any fixed dbase- The induction step is involved: all of the following 
subsection is devoted to it. The reader interested mainly in the application to the routing lower 
bound can safely skip this proof on first reading and continue with Sect. [3| 



2.2. The inductive step 

It is obvious that the expected number of steps of the budget game for an optimal strategy and 
the lower bound stated in the Main Lemma are monotone decreasing in B. On the other hand, it 
is not clear (and we will never use) that the expected number of steps of the game for an optimal 
strategy is monotone in d. 

Consider a distance d>2 with remaining budget B >0. Let L = [logdj. 

Suppose strategy S dictates that in state {d, B) the player chooses the valid bet /3. Recall that 
if step size i G {2, 1} is chosen, the budget B decreases by (i/d)3/^/3((i/2, d]) , and the 

remaining distance is d — i. Thus, by the induction hypothesis, the remaining time is at least 

a ■ ln^(d -i) n o ^ • j 

^ ^ for 2 < z < d. 



l + S-(i/d)3/2/3((i/2,d]) 

If step size i = 1 is chosen, the budget remains B and the remaining distance is z — 1. For i = d, 
the remaining time is 0. Hence, the inductive assertion for d follows from the following lemma: 

Lemma 3 There is a constant a > such that for any budget B > 0, distance d > 2, and bet (3 
valid in state (d, B) we have 

i_Lflcn Q-ln^(^-l) I Of. a-ln^(d-i) ^ a-ln^(d) 

^ + B +^|^/^^^-l + i?-(z/d)3/2/3((,/2,d]) - l + B ■ 

The term 1 on the left hand side corresponds to the step that is being made in state (d, B) and 
leads to a new state d — i. The other terms in the sum are the lower bounds (as asserted by the 
induction hypothesis) for the remaining number of steps for each step size i, each multiplied with 
the probability that a steps of size i is made. There is no term for i = d, as after a step of size d 
the game ends. 

In the remainder of this subsection we prove Lemma [3| 

First note that for all d > 2 we have In^(d) — ln^(d — 1) < 1. Since /3(1) < 1 and > 0, we obtain 
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Thus, to prove Lemma [3] it suffices to show that 

1 a-ln^{d-i) 

2 + ^^J^'' ■ l + B-{^/dr/^./3{{^/2,d]) 

> (l - /3(1)) "^^^^^^ , for sufficiently smaU a > 0. (1) 
If /3(1) = 1, the right hand side evaluates to 0, so the claim is true. Thus, in the following we assume 

m < 1. 

We merge step sizes into orders of magnitude and consider the resulting probabilities, gi, that a 
step size is of the order of magnitude i: 

<?£:=/3((^,|]),for£G{0,...,L-l}. 
(Note that = d/2Li°S'^J G [1,2), and so gi-i = ^{[2,d/2^-^]).) 

Suppose step size i e {2, . . . , d—1} is applied. Then for £ = [log(d/i)J , we have i/2 = d/2^°^^'^/^^^^ < 
d/2^+^ and i/d = 1/2^°^^'^/'^ > 1/2^+^. Hence, we can bound the budget loss from below as follows 
(note that many terms are omitted!): 

my'.p{md])>^^^^. (2) 

The new distance is 

d-i>d- d/2^. (3) 

Note that ln^(z(l - x)) > In^(z) - 3x(ln2;) for all z > 1 and all x £ [0, ^] (see Claim 
appendix). Thus, for £ > 1, 

ln2((i-(i/2^) =ln2((i(l-l/2^)) >ln2(d)-3(lnd)/2^. (4) 

Hence, for each i E {1, . . . , L — 1} we have 

V- a-lnHd-i) f ^ a.ln\d-d/2') 

2^ ^^>'l + B-(i/dW^-(3((i/2,d])- ^ ^ ■ 1 + W23(^+i)/2 

a-\^{d-dl2^) @ ,^ ln(i-3/2^ 

= • 1 + 5 - ^,/23(^+i)/2) • ^ « • 5. • (Ind) • ^ ^ ^ _ ^^/23(.+i)/2 • 

For £ = we need a stronger bound on the expectation of \x?{d — i), which relies on the bound on 
the probability of obtaining large step sizes imposed by (B2). We derive such a bound using the 
following claim. 

Claim 4 Let d* = d — [d/2\ and let /i be an arbitrary probability distribution on {0, . . . ,d* — 1} 
with the property that /i({0, . . . , j — 1}) < 2j/d* , for 1 < j < d*. Then 

H{i) In^ii) > ln\d) - O(lnd). (6) 

l<i<d* 
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in the 
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Proof: Since is increasing in i, the sum is minimal if fi puts as much weight as possible on 

the smallest numbers in {0, . . . , d* — 1}. By the inequality /i({0, . . . , j — 1}) < 2j/d* it is clear that 
the distribution 

1^ ,if0<i<(d*-l)/2, 
= ^ — , if is odd and i = {d* - l)/2, 



[ , if (d* - l)/2 <i<d\ 



will achieve this minimum. Thus 

5^ ^,{i)ln\i)>^- 5] ln\i). (7) 

l<i<(i* l<i<(d*-l)/2 

We assume that d > 3 and that d* is even (and hence i < d* /2 if and only if i < (d* — l)/2); the 
calculation for odd d* is similar. Utilizing that In^(x) is increasing in x we may easily bound the 
last sum from below by comparing it with an integral, as follows. 

ln^{i)> / ln^{x)dx-ln'^{d*/2) 

l<i<d*/2 ^ 

= [x\n^{x) -2x\nx + 2xY*''^ -2\n^{d* /2) 

= {d*/2) \n^{d*/2) - d* \n{d*/2) + {d* -2 - 2\-n^{d* /2)) 

> {d*/2) ln^{d*/2) - d* ln{d*/2). 

In combination with ([T]) we obtain 

/i(i)ln2(i) > ln^{d*/2) - 2ln{d*/2). 

l<i<d* 

Now d*/2 > d/4, and hence ln^{d*/2) - 21n(d*/2) > ln2(d/4) - 21n(d/4) > ln^{d) - 2(ln4)(lnd) - 
2 In d = ln^{d) - 0(ln d). Thus Claim ^ is proved. ■ 

Let d* = d- [d/2\. Recah that go = /3((d/2,d]) = /3{[[d/2\ +l,d]) = /3{[d- d* + l,d\). We define 
a probability distribution on {0, . . . , d* — 1} by = I3{d — i) / g^. According to property (B2) 
/i satisfies 

/^(0,J-1) = <— forl<j<d. 

go d* 

Hence we can apply Claim |4] to see that there is a constant C (the same one for all d, B, and all 
valid budget bets such that 

go-ilnd){\nd-C')<go- Yl /"W-ln'(i)= Y 9o ■ Kd - j) ■ l^i^d - j) 

l<i<d* d-d*<j<d-l 

= Y /3(i)-ln2(d-j)= Y m-l^\d-j). (8) 

[d/2\<j<d d/2<j<d 
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Let C := max{3, C"}. We bound the sum on the left hand side of ([T]) from below by grouping terms 
according to order of magnitude of the corresponding step sizes and by applying ([s]) for group £ = 
and ([5]) for all other groups. (In order to bound the denominator for group £ = we use relation 

(§•) 



a • In {d — i) 
2<,<, ^ + i?-(W/2./3((V2,d]) 



^, Ind-C v-^ ^, lnd-3/2^ 

- " • • ^^"'^ • 1 + - .0/23/^ + ^^g^^ a • • (Ind) . ^ ^ ^ _ ^^^^3^,^,^/, 



n „ lnd-C/2^ 
>a.{lnd). ^ g^- i + i^_g,/23(m)/2 (9) 

0<£<L-1 



Applying this to ([T]), we see that to prove Lemma [s] it suffices to show 

1 ,^ ln(i-C/2^ , ..a-ln^fd) , , 

0<£<L ^'^^ 

Let 7£ = ge/{l - for ^ = 0, . . . , L - 1 and let y = (1 + B)/{l - (RecaU that we need 

only consider the case /3(1) < 1.) Then y > 1 and gi = j£ ■ {1 + B)/y, and so it suffices to show that 
Z' > 0, where 

/ y y sr^ Ind — 



y ^ lnd-C/2^ 



2a-lnd+^Ej'" l-7,/(23(m)/2y) 



Ind (111 



Recall that 

ff^ = /3([2,d]) =1-/3(1). 

0<f<L 

Hence l^o<£<L 7^ = 1; ^-^id so 

lnd= ^ 7£-lnd. (12) 

0<1<L 

Note also that 

1 + 23(.?by ^ forallO<£<L, (13) 

because y > 1 and 7^ < 1. Moreover, 1/(1 — x) > 1 + x for all real numbers x < 1, and using this 
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inequality for x = 7^/(2^(^+^)/^y) yields 



+ 2^ 93(^+l)/2„ - ^ 1 + 



2a-lnd ^ 'M23(^+i)/2y 2M '23(^+i)/2„ 

y Inc; ^ 7^^ 3C >p 7^ ...X 

2a-lnfi 23/2^/ ^ 23^/2 2 2^ 2^' ^ ^ 
^ 0<€<L o<e<L 

A lower bound for the second summand can be obtained using the following inequality, which is 
proved using the Cauchy-Schwarz inequality. 



Claim 5 Let xi, . . . , Xm G IR- Then 

(E E 



23V2 • 

l<i<m l<i<m 



Proof: Recall that the Cauchy-Schwarz inequality states 



l<i<m l<i<m l<i<m 

for arbitrary reals ai, 61, . . . , am, ^m- Define aj = Xi 

/23^/4 and 6^ = 1/2*/^. Then 



E ir - ( E ^ ( E «.^) ■ ( E ^.^) - ( E E ^ 

l<.i<m l<i<m l<.i<m, l<i<m l<j<m l<«<m 

The claim now follows immediately from the geometric series 

2^ ^<Z^^-l_l/y2" 



l<i<m j>l 



Applying Claim [5] to the sum in the second term of (14) we obtain 



E 

o<e<L 



23£/2 



> 



. 0<£<L 



1 



2 + V2 



Hence, defining S = X^o<f<L7^/2^ using that 23/2 .(2 + ^f2) = 9.6568 . . . < 10, we obtain 



Z' > 



+ 



2a-lnd 23/2(2 + ^2)? 



E 

.o<e<L 



2^ 



3C \ - 7£ 
^ 2^ 2^ 

0<£<L 



> 



y Ind 2 3C 

2a-lnd+102/ 2 '^^ ^^^^ 
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Clearly, neither y/{2a\nd) nor lnd/{Wy) are negative. If y > 3CSa\nd, then y/{2a\nd) > 3CS/2 
and so Z' > 0. Thus, it suffices to consider y < SCSalnd. In this case 

7/ ^ ^"^d 2 3C 3 f 1 \ 

- 30CSa-lnd'^ ' ^ ' ^ ' 2 [a ■ A5 ■ V' 

This term is non- negative for a < 1/ (45 • C^) . This completes the proof of Lemma |3| and thus the 
induction step in the proof of Theorem [T] ■ 



3. Application to Greedy Routing in Small-World Graphs 
3.1. Greedy routing on a grid 

Consider the D-dimensional infinite grid Z^, for D > 2. The distance measure used is the "Man- 
hattan distance" induced by the "Manhattan norm" 

. . .,xd)\\i = \xi\ H h |a;D|- 

Fix some distribution A over Z^, which we will call the long range contact (short: Ire) distance 
distribution. Every node u on has a long range contact that is determined by the following 
random experiment (executed independently for all nodes u): First, a distance r is picked according 
to the Ire distance distribution A, and then n's long range contact is chosen uniformly at random 
among all nodes v with — = r. (The combination of these experiments defines the augmenting 
distribution.) We consider the directed random graph in which every node in Tj^ has one outgoing 
edge to each of its neighbors on the grid, and one edge to its long range contact. 

We are interested in the expected greedy- routing time from an arbitrarily fixed source node, s, 
to a fixed target node, t. The greedy-routing time is the length of the path from s to t that is 
obtained by following in each step the edge that minimizes the Manhattan distance to t (ties 
broken arbitrarily). For symmetry reasons we may assume w. l.o.g. that t = 0^ = (0, . . . , 0). Our 
main result is summarized in the following theorem. 

Theorem 6 Let A be an arbitrary Ire distance distribution. Assume TP is augmented with long 
range contacts chosen according to A. Then for every starting node s G Z^ the expected greedy 
routing time from s to 0^ is $7 (log^ Iklli) ■ 

Remark 1 For simplicity we formulate the theorem in terms of the infinite grid, but it applies 
equally well to the Z?-dimensional finite grid Gn = {0, . . . ,n — 1}^ with edge length n (with the 
edges induced from Z-^ and the Manhattan distance measure) and the D-dimensional finite torus 
Td = {0, . . . , n — 1}-^ (with the edges of Gd plus "wraparound edges" from (xi, . . . , n — 1, . . . , xd) 
to (xi, . . . , 0, . . . , xd), and the shortest path distance). The statements carry over directly as long 
as s and t have distance smaller than n/4 (on To) and have distance at least 2 ||s — from the 
border of the grid (on Gd)- 

The rest of this section shows how to utilize Theorem [T] to prove Theorem |6j 
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3.2. Simulation of routing by a budget game 

To prove Theorem [6| we wish to apply our results for the budget game to greedy routing. As 
an intermediate step, we introduce a game G, played in rounds on Z^, which generalizes greedy 
routing. The state of game G is a distance d G N; the initial state is some d^. When in state d > 0, 
the player chooses a point u G with \\u\\^ = d arbitrarily. Then, using the Ire distribution A as 
described above, she carries out a random experiment to obtain a long range contact v of u. The 
round ends with the new state being d' = m.m.{\\v\\^ ,d— 1}. The game ends once state d = has 
been reached. The cost of a run of G is the number of rounds carried out. 

A strategy for the player is a function that for each distance d gives some vertex u with \\u\\-^ = d. 
If the player adheres to a fixed strategy for choosing u in each step, the cost becomes a random 
variable that only depends on the random experiments used for finding the long range contacts. An 
optimal strategy is one that minimizes the expected cost. (For given A, an optimal strategy can be 
determined by induction on d = 0,1,2, .. ..) 

It is obvious that if game G is played starting from do with an optimal strategy, then the expected 
cost (i.e., the expected number of rounds until the game ends) is not larger than the expected 
greedy routing time in from any start node at distance do to 0^. Thus, it suffices to prove that 
for any start distance do and any strategy the expected number of rounds of game G is 0((log do)^) . 

Now assume an arbitrary strategy Sq for game G has been fixed. Then for every distance d strategy 
Sg induces a probability distribution on {1, . . . ,d} as follows: Sq dictates which node u with 
||tt||^ = d to choose. Node u has some grid neighbors of distance d — 1 from 0^ and one long range 
contact V, chosen at random on the basis of Ire distribution A, as described before. One chooses 
some neighbor v u that minimizes \\v\\-^, and advances by d — ||f ||]^ ( > 1) to the new state ||f H^. 
For 1 < i < d, (3d{i) is defined as the probability that the progress d — min{d — 1, \\v\\j^} is equal to 
i. 

Now we can describe how, given a strategy Sq for game G, the game G played with Sq may be 
simulated by a budget game Gb played with a strategy 5b. The initial budget is some constant 
-Bo (independent of Sg', value to be determined later). The initial distance is do, as in game G. 
When at distance d, the bet by the player of the budget game is the probability distribution (3d on 
{1, . . . ,d} as defined in the previous paragraph. The effect is that in one round of Gb the player 
moves from state d to state d — i with probability (3d{i), for 1 < i < d, exactly as in game G with 
strategy Sg- From this it is obvious that the expected number of rounds game Gb needs to finish 
is exactly the same as in game G with strategy Sg- 

Note, however, that before we can say that Gb is a budget game in the technical sense, so that 
the results of Section [2] can be applied, we have to make sure that the defining constraints on the 
probability distributions f3d used in the bets of Gb are satisfied. In a round in which one moves 
from state d to state d — i, i > 2, the budget shrinks by (i/d)^/^/3rf((i/2, d]). (For i = 1 the budget 
remains unchanged.) For Gb to be a genuine budget game it is sufficient that (3d is always a valid 
budget bet, i.e., that constraints (Bl) and (B2) on the probability distribution (3d are satisfied 
when state d is reached with remaining budget B in the budget game. If this is the case, then the 
simulation Gb of game G with strategy Sg is a legitimate budget game, and Theorem [T] can be 
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applied. 

In the following, we develop two lemmas which show that jid always satisfies (Bl) and (B2) if the 
constant starting budget Bq is large enough. This will then prove Theorem |6j 

3.3. The budget suffices 

The first lemma deals with property (Bl); it implies that if in G-q state d is reached and the 
remaining budget is B, then B is large enough to accommodate the next bet. 

Lemma 7 Let € [l,c^o) state that can he reached in game G after k rounds, i. e., there are 
states dk < dk-i < • • • < di < do and step sizes is = ds — dg+i, < s < k, such that (3d^{is) > 0. 
Then for Bq> 21, 

3/2 



E 

0<s<fc 
is>l 



d. 



Pd^{{is/2,ds\) > 1. 



(16) 



Note that in order to satisfy (Bl) when at distance d^, it would even suffice that the remaining 
budget is ([2, d^]) , while our lower bound on the remaining budget is 1. 

of Lemma O Suppose a node u with \\u\\i = du has a long range contact v with ||f ||-|^ = d^ < du- 
By the triangle inequality, \\v — u\\^ > du — dy, and since dy < du, we have \\v — u\\-^ < d^+du < 2du- 
Thus, in game G in order to go from state d to some state in [0, d'], d' < d — 2, the node u with 
= d (which is chosen by the player) must have chosen a long range contact v such that 
d — d' < \\v — < 2d. It follows that 

/3d{[d - d', d]) <X{[d- d', 2d)) for any 1 < d' < d - 2. 

We define A(/) = Xlie/ -^(^) / C N. It suffices to show that 

3/2 



Bo- E 



0<s<k 
is>l 



X{{is/2,2ds)) > 1. 



(17) 



We have 



E 

0<s<fc 
is>l 



3/2 



A((i,/2,2d,)) = E 



0<s<fc 
is>l 



3/2 



yis/2<j<2ds 



2<j<2do 



E 



0<s<A;: 
l<is/2<j<2ds 



3/2 



15 



Since X]2<j<2do '^(•?) — ^' suffices to sliow for every j G [2, 2(io) that 

/ ■ \ 3/2 

Bo-l> E (j-)- (18) 

l<is/2<j<2ds 

Fix j e [2, 2do) arbitrarily. For i £ [O, [logdj] let S{£) be the set of indices s £ {0, . . . ,k - 1} such 
that 

1 < is/2 <j< 2ds and ds G (cio/2^+\ 

Then 

Let So be the smallest index in S{i), i. e., state ds^ is reached in the budget game before any of the 
step sizes is, s £ S{£), are applied. Since all step sizes is, s £ S{£), can still be subtracted from 
without reaching state 0, we have X^se5(£) ^ ^■^o — In addition, is < 2j for all s £ S{£), so 

by convexity of the function x i— >• x^/^, 

J2 ^s^'^ < '-^ ■ {2jfl- = I . [2jr\ 
ses{e) 



Using this in (19) yields 

2^x1/2 



Now note that S{i) = and thus q = for do/2^ < j/2, i.e., for £ > log{do/j) + 1. Hence, 

0<s<k: ^ 0<^<logd 0<<?<log(do/j)+l 

l<is/2<j<2ds 

" V*^ o<M.-a./„« ^/2-l 

\doJ V2-1 

This proves ([T]) for Bq > 21, and thus the lemma. 



3.4. A geometry lemma 

It remains to show that the probability distributions Pd that arise in the simulation of game G by 
Gb satisfy condition (B2). As before, let d* = d - [d/2\ ; recah that {d/2, d] = [d - d* + l,d], a set 
of size d* . 
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Lemma 8 For all distances d > 3 and all 1 < j < d* , 

(3a{[d-j + l,d]) <'^.f3^([d-d* + l,d]). 

For w E the the Manhattan bah with radius t around w, which is {x G Z-^ | ||x — t(7||i < t}, is 
denoted by B^^t, and the Manhattan sphere with radius t around w, which is {x G | — = 
t}, is denoted by S^^t- 

Recall how (3^ is defined. The player in game G chooses a node u with \\u\\-^ = d. The Ire distribution 
A is used to choose some distance r; afterwards the long range contact v itself is chosen uniformly 
at random from Su,r- It is obvious that it is sufficient to prove the inequality in Lemma [8] under 
the condition that u and r are fixed. Note that the jump distance i = d — \\v\\^ is in [d — j + l,d] 
if and only if < J — 1, which means that v is in the Hamming ball Bqj-i. The jump distance 
is in [d — d* + 1, d] if and only if ||f < d* — 1. We can restrict out attention to Ire lengths r with 
which one can reach at least one such point v. Because on Su,r the uniform distribution is used, for 
proving Lemma [8] it is sufficient to show the following. 

Lemma 9 Let u € Z^ with \\u\\ = d, and let d* = d — \ d/2\ . Assume that Su,r intersects -Bo,d*-i- 
Then for 1 < j < d* the following holds: 

\Boj-i n Su,r\ ^ 2j 
|-Bo,d*-l n Su,r\ ~ d* 

In words: If j < d* , then among the set of points on a sphere with radius r around u that are 
strictly closer to the origin than d* not more than a fraction of 2j/d* is strictly closer to the origin 
than j. 

Note. Assume D = 2. With u on the xi-axis one can achieve that 2j — 1 points are in ^oj-i ^ Su,r 
and d* + j points are in i?o,d*-i ^ Su,r- Assuming d* is large and j is small shows that the factor 2 
in the lemma is best possible. 

Proof. We start with some preliminary remarks. From Su,r H -Bo,d*-i 7^ it follows that d < 
r + d*-l = r + d- [d/2\ - 1, hence r > [d/2\ + 1 > d*. If Bqj^i n Su,r = 0, there is nothing to 
show. So, if needed, we will assume that -Boj-i H Su,r 7^ 0- 

A vertex (of Su,r) is an element of Su,r that maximizes or minimizes one of the components. There 
are 2D vertices; they have the form u it (0, . . . , 0, r, 0, . . . , 0), with exactly one nonzero component 
in the second summand. It is easy to see that i?o,d*-i can contain at most one of these vertices: 
two vertices have Manhattan distance exactly 2r, but two points in i?o,ci*-i cannot be further apart 
than 2{d* — 1), which is smaller than 2r. 

If Bq^ii*-i contains one vertex w, the intersection i?o,d*-i ^ Su,r does not change if u is moved away 
from w along the line that connects w and u, and r is increased accordingly. The same is true if 
-Bo,d*-i does not contain a vertex at all. We see that the statement we need to prove does not really 
depend on r and n, only on the shape of the intersection i?o,d*-i H Su,r- A moment's thought shows 
that is sufficient to show the following (and apply it for d* = i). 
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Claim: Consider two balls -Bo,i-i find -^o,j-i around the origin, with 1 < j < i. Assume that some 
sphere Su,r intersects i?o,i-i in such a way that -Bo,i-i contains at most one vertex of Su,r- Then 

Q = Q{hj,u,r) = I^O-J~i ^ ^"■'^1 < 

The claim is proved by induction on D. 
Basis: D = 2. 

For symmetry reasons we may assume that the leftmost ("westernmost") vertex of Su,r is in i?o,j-i) 
if any. We may further assume that r is large enough so that certain manipulations with Su,r are 
possible without another vertex coming close to i?o,i-i- We may assume that -Bo,j-i H Su,r / and 
2j < i, since otherwise the claim is trivially true. We consider some cases. 

Case 1: -Bo,i-i does not contain a vertex of Su,r- — Then the intersection -Bo,j-i H Su,r is a straight 
line with i or i — 1 points. The intersection -Boj-i ^ Su,r is either empty (and hence Q = 0) or a 
straight line with j oi j — 1 points. Hence Q < j/ (i — 1) < (j + l)/i < 2j/i. 




Figure 1: Case 1. i3o,i-i (large ball) is green/lighter, Soj-i (small ball) is blue/darker, the bent line is a 
part of Su,r (red). |i?o,i-i H Su.r\ = 7 = i — 1 and |_Boj-i H = 3 = j/. 

Case 2. i?o.i-i contains the leftmost vertex of Su,r, but this vertex is not in i^oj-i- — Then the 
intersection -Boj-i H 5'u,r is a straight line with j or j — 1 points. We move u parallel to this 
line until the leftmost vertex of Su,r moves out of i3o,i-i- This change decreases the denominator 
\Bo,i-i n Su,r\, but leaves the numerator |i?oj-i H Su,r\ unchanged. Applying Case 1 yields the 
desired inequality. 

Case 3: The leftmost vertex of Su,r is a point (z, 0) on the xi-axis, inside i?o,i-i- Then —j<z< j. 
Let y = z — 1 + j , hence < y < 2j — 2. Then |i?o,j-i H is either 2j — y — 2 = j — z — 1 or 1 
more than this; in any case we have |-Bo,j-i ^ Su,r\ ^ j — z. Similarly, |i?o,j-i H /S'M,r| > ^ — — 1. 
Hence Q < {j — z)/{i — z — 1), which is a number < 1 (since 2j < i, hence j < i — 1). Increasing 
numerator and denominator by the same summand increases the fraction, hence 

^ 1 — z i — z j + j 2j 

i — z — 1 i — z — 1 i + j — 1 i 
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Figure 2: Case 2. Bqa-i, Bqj-i, and Su,r as in Fig. [ij Moving Su,r to the southwest until the vertex is 
outside _Boj"-i does not change Su.r H -Bqj-i and makes the intersection with Su,r H Bq ^^i smaller. 




Figure 3: Case 3. Bo.i-i, So.j-i, and Su^r as in Fig. [ij Here: i — 8, j — A. The leftmost vertex of Su,r 
is (—1,0) = {z,0). Hence y = 2. |-Boj-i H Su^r\ = j — z = 5, while |i?o.i-i ^ S'u,r | = i — z = 9. We have 
5/9 < 8/8 = 2j/i. 

Case 4: The leftmost vertex (z, z') of is inside i?oj-i, but not on the xi-axis. Assume z' > 0, so 
it is above the xi axis. Move u in southwest direction until it hits the xi-axis. This means that the 
leftmost vertex moves to {z — z',0). These changes increase both \Bqj-i H Su,r\ and |-Bo,i-i H Su,r\ 
by z' , hence Q increases. Applying Case 3 yields the claim also in this case. 

Induction step: D > 2. 

As induction hypothesis we assume that the claim is true for D — 1. We cut into hyperplanes 
("layers") Lg = {{s, X2, . . . ,xd) \ X2, ■ ■ ■ ,xd £ Z}, for s £ Z. If j — \s\ < 0, the intersection -Bo,j-i H 
Su,r n Ls of our configuration with layer Ls is empty, so it does not contribute to |i?o,j-i H Su,r\, 
and we may ignore this layer. Assume \s\ < j. Intersecting Lg with i?o,i-i) -Soj-i, and Su,r, and 
ignoring dimension 1 gives balls with radius i — |s| — 1 and j — |s| — 1 around the origin and a sphere 
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Figure 4: Case 4. i?o,i-i, Bq ^^i, and Su^r as in Fig. Ill Moving Su,r in southwest direction until the leftmost 
vertex hits the a:i-axis increases |i3oj-i H S^^rl (by 1) and does not change |(i3o,i-i — -Boj-i) 'S'^^rl- 

Su'y, all in Z^^-*^. The crucial observation is that only one vertex of Su'y can lie in i?o,i-i- The 
induction hypothesis yields that restricted to Lg the ratio between points in -Boj-i and i?o,«-i is 
Q{i—\s\,j — \s\,u\r') < 2{j — \ s\) / {i — \ s\) < 2j/i. Summing this over all layers Lg, for —j<s<j, 
yields that Q{i,j,u,r) < 

This ends the induction step, and the proof of the claim, and the proof of the lemma. ■ 

4. Conclusion 

We presented the first lower bound for greedy routing in augmented D-dimensional grids and tori 
for D > 2, for any uniform and isotropic augmenting distribution. Together with the tight lower 
bound for rings and lines this settles the question whether for all dimensions D the inverse 
D-th power distribution is the optimal uniform and isotropic augmenting distribution for greedy 
routing in Kleinberg's small world graph model. It seems to us that the new lower bound technique 
presented here is easier to understand than the one applied in [4^ for the one-dimensional case. The 
analysis of budget games yields interesting insights into the reasons why faster greedy routing is 
not possible. We also think that budget games are an interesting concept in their own right. 

We believe that it is not hard to extend our lower bound technique to prove a lower bound for the 
greedy diameter of the line (i. e., to obtain the same result as in [s]). To obtain a tight lower bound 
for greedy routing on the ring between two randomly chosen nodes as in [1] may not be as easy, 
but we conjecture that it is possible. 

Our lower bounds hold regardless whether every node has one or k independently chosen long 
range contacts, as long as /c is a constant. For super-constant k this is not clear. For k = O(logn) 
and any constant D > 1, greedy routing on the D-dimensional torus or grid augmented with the 
inverse D-th power distribution takes only 0((logn)'^/A;) time. It seems likely that our lower bound 
technique can be generalized somehow to show that this is optimal for all uniform and isotropic 
augmenting distributions, but a full proof seems to require significant additional effort. 
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A. Additional Proof 



Claim 10 For all z > I and x G [0, |] we have 

ln(z(l - x)f > ln2(z) - 3a;(lnz). 

Proof: The claim is obvious for z = 1, so we may assume z > 1. Note that ln(l ~ x) > —3x/2 for 
all X G [0, This is immediate for the boundary cases x = and x = 1/2 and thus follows for all 
X G (0, ^) since the function x ln(l — x) is concave. Hence, 

ln2(z(l - x)) = ln^z + 2(lnz)(ln(l - x)) + ln^{l -x)>ln'^z- 3x{lnz). 
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